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ABSTRACT 


The  APPS-IV  analytical  plotter  has  been  modified  to  permit 
the  superposition  of  graphics  data  from  a  data  base  into 
the  optical  path.  This  data  is  projected  into  the  stereo 
model  in  photo  image  coordinates.  Under  real-time  micro¬ 
processor  control,  the  graphics  display  is  translated  on 
the  face  of  the  CRT  to  maintain  registration  with  the  image 
as  the  stage  is  moved.  With  graphic  superposition,  geo-  / 
graphic  data  can  be  displayed  directly  in  the  stereo  model  / 
as  it  is  digitized.  In  addition,  data  previously  compiled/ , 
can  be  displayed  as  well  as  information  from  entirely  /  * 
different  sources.  / 


INTRODUCTION 
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The  APPS-IV  Analytical  Plotter  was  originally  developed 
as  an  efficient  tool  for  the  direct  digitizing  of  geo-/ 
graphic  data  base  information  from  stereo  photographs%A 
From  the  inception  of  the  development,  it  was  evident  to 
the  personnel  involved  that  an  additional  capability  was 
required  to  permit  the  image  interpreter  to  digitize  the 
data  in  real  time  as  he  interpreted.  The  missing  link  was 
the  capability  for  the  interpreter  to  see  what  he  had 
previously  digitized.  Separate  CRT  displays  to  the  side 
of  the  instrument  provide  some  aid,  but  in  order  to 
operate  most  efficiently,  the  operator  must  be  able  to  see 
the  graphics  at  the  same  time  he  is  viewing  the  stereo 
model. 


Under  contract  with  the  U.S.  Army  Engineer  Topographic 
Laboratories,  Autometric  developed  a  capability  to 
accomplish  the  superposition  of  the  digitized  graphic  data 
into  the  stereo  model  as  it  is  being  digitized.  With 
this  capability,  the  APPS-IV  becomes  an  instrument  which 
will  truly  support  real-time  interpretation  and  simultaneous 
digitizing  within  the  stereo  model. 

This  paper  will  first  discuss  the  implementation  of  the 
graphics  superposition,  and  then  describe  uses  of  the  media. 

IMPLEMENTATION  OF  GRAPHICS  SUPERPOSITON 

At  first  glance  the  technique  of  superposition  would  seem 
obvious.  One  must  introduce  a  beamsplitter  into  the 
optical  train  to  allow  the  light  from  a  graphics  display 
to  be  introduced  into  the  optical  path  and  be  superimposed 
on  the  imagery.  Several  technical  questions  had  to  be 


considered  as  part  of  the  design  effort.  The  first 
question  was  whether  to  introduce  the  graphics  into  one 
or  both  optical  paths.  After  analyzing  the  problem,  it 
became  obvious  that  the  graphics  could  be  introduced  into 
only  one  optical  train,  since  the  graphics  must  coincide 
with  at  least  one  conjugate  image  to  overlay  the  digitized 
point  in  the  stereo  model.  Therefore,  simplicity  and 
economy  lead  to  the  decision  to  introduce  the  graphics  into 
one  optical  train.  The  next  fact  which  follows  logically 
is  that  the  graphics  must  be  introduced  in  terms  of  stage 
coordinates  of  the  points  in  the  imagery,  since  doing 
otherwise  would  cause  the  graphics  to  fail  to  overlap 
the  digitized  features  in  the  imagery.  This  allows  the 
graphics  for  a  road,  for  instance,  to  overlay  exactly  the 
imagery  of  the  road  in  one  optical  train.  In  fact,  this 
effect  is  almost  identical  to  that  which  is  seen  in  most 
stereo  digitizing  of  previously  interpreted  data,  where 
an  interpretation  overlay  is  placed  over  one  of  the  photo¬ 
graphies.  Of  course,  with  the  superposition  capability 
the  operator  can  see  the  drawing  of  the  overlay  as  he 
outlines  the  feature  with  the  floating  mark. 

As  a  by-product  of  the  superposition  capability,  by 
placing  a  TV  camera  above  the  beamsplitter,  one  can  tap 
out  a  one-to-one  display  of  the  imagery.  This  display 
permits  others  watching  the  compilation  operation  to 
observe  the  progress,  and  to  be  consulted  should  questions 
occur.  This  is  obviously  important  in  any  training  en¬ 
vironment,  but  is  also  useful  in  illustration  of  compil¬ 
ation  principles.  In  addition,  use  of  a  suitable  camera 
and  interface  can  provide  digital  images  for  digital  image 
processing  and  pattern  recognition  experiments. 

To  simplify  the  optical  system,  the  graphics  CRT  is  viewed 
at  the  same  magnification  as  the  imagery.  If  one  were  to 
use  an  ordinary  large  tube,  the  width  of  the  graphics  line 
would  be  too  large  to  permit  any  fine  detail  to  be  traced. 
To  lessen  the  width  of  the  line.  Autometric  obtained  a 
smaller  tube  from  the  vendor.  This  tube  has  a  resolution 
of  2048  x  2048,  over  an  imaging  area  of  4  by  4  inches, 
yielding  a  2  mil  resolution.  The  actual  line  width  is 
about  4  mils,  or  100  micrometers,  which  provides  sufficient 
resolution  in  the  optical  overlay  to  define  rather  fine 
features,  but  is  still  broad  enough  to  be  readily  seen  by 
the  operator. 

Until  now,  only  the  static  problem  has  been  considered  and 
the  problem  of  linking  the  display  coordinate  system  to  the 
CRT  screen  has  not  been  discussed.  Normally,  to  determine 
a  coordinate  transformation,  one  would  use  the  cursor  in 
the  APPS-IV  to  measure  points.  We  wish  to  determine  the 
stage  position  of  points  on  the  face  of  the  CRT  with 
respect  to  the  stage,  but  unfortunately  the  measuring  mark 
position  is  always  fixed  with  respect  to  the  screen,  as 
the  screen  never  moves.  Thus,  some  other  measuring  mark 
must  be  used.  Suppose  one  were  to  measure  the  position 
of  a  distinct  object  in  the  imagery,  so  that  its  stage 
coordinates  were  known.  Now,  by  moving  the  measured  mark 


to  overlay  objects  placed  at  known  positions  in  the  screen 
coordinate  system,  one  could  determine  the  relationship 
between  the  ePtage  and  screen  coordinates,  from  a  measure¬ 
ment  of  stage'  translations  relative  to  the  stage  position 
when  the  distinct  object  was  under  the  reticle. 

Now  consider  an  additional  element  of  complexity.  The 
image  on  the  CRT  must  follow  the  stage  position  as  the 
stage  is  moved.  First  of  all,  this  obviously  requires  a 
refresh  CRT,  as  a  storage  CRT  obviously  cannot  slew  the 
position  of  the  image  on  the  screen.  In  addition,  there 
must  be  a  capability  to  constantly  monitor  the  stage 
position,  so  that  the  graphics  position  can  be  updated 
about  twenty  or  more  times  per  second  to  prevent  the 
appearance  of  jerky  movements.  Moreover,  to  maintain  the 
APPS-IV  philosophy  of  not  placing  real-time  demands  upon 
the  host  computer,  this  must  be  accomplished  internally 
to  the  APPS-IV  instrument.  The  approach  we  used  was  that 
of  adding  a  graphics  control  microprocessor  to  the 
instrument,  which  functions  to  determine  the  required 
position  of  the  display  in  real  time  as  the  stages  are 
moved  by  the  operator.  In  addition,  since  points  are  being 
written  to  the  display  by  the  host  as  they  are  being 
compiled,  this  microprocessor  must  act  as  a  multiplexer 
for  commands  from  the  host,  so  that  commands  to  draw  points 
from  the  host  are  not  intermingled  with  commands  to  move 
the  display  from  the  microprocessor.  Since  both  commands 
are  strings  of  characters  transmitted  asynchronously  over 
an  RS-232c  interface,  characters  from  one  command  string 
could  be  interspersed  with  characters  from  another  string, 
without  this  multplexing  capability  these  mixed  messages 
would  appear  to  the  display  drivers  as  unintelligible. 

Thus  the  display  microprocessor  must  buffer  the  messages 
until  they  are  complete,  and  then  send  them  out  serially  to 
insure  message  integrity.  This  microprocessor  concurrently 
performs  the  rather  extensive  real-time  floating  point 
computations  to  determine  the  position  of  the  display  as 
c  a  function  of  stage  position  of  the  APPS-IV.  This  micro¬ 

processor  is  isolated  from  the  other  APPS-IV  micropro¬ 
cessors,  even  to  the  extent  that  while  they  share  the  same 
bus  for  communications,  the  Read-Only-Memory  and  Random- 
Access-Memory  are  on  the  display  microprocessor  board,  so 
that  accesses  are  made  without  bus  priority.  Thus  there 
is  no  impact  whatsoever  upon  the  speed  of  normal  stereo 
maintenance  computations.  The  ability  to  control  bus 
access  to  this  extent  is  the  result  of  the  fact  that  the 
APPS-IV  microprocessor  design  consists  of  a  custom  design 
\  developed  specifically  for  this  application.  Such 

performance  cannot  be  obtained  from  standard  microprocessor 
boards  available  off-the-shelf. 

USES  FOR  GRAPHICS  SUPERPOSITION 

It  was  originally  conceived  that  graphics  superposition 
would  be  used  only  for  displaying  what  was  currently 
;  being  digitized,  or  at  most,  displaying  the  data  set  which 

was  being  edited.  In  this  mode,  the  capability  would  allow 
*  the  interpreter  to  keep  account  of  his  progress,  and  to 

f  see  the  nodes  which  he  needed  to  join  on  the  overlay,  If 

II.  I  the  data  being  displayed  were  previously  digitized  data 
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(the  capability  is  present  to  convert  geographic  coordin¬ 
ates  back  into  image  coordinates  for  display)  the  super¬ 
position  capability  gives  the  user  a  direct  means  for 
comparing  previously  digitized  data  bases  with  new  stereo 
photography,  which  will  greatly  increase  the  efficiency  of 
updating  previous  data  base  information  with  new  photo-  • 
graphy  on  the  APPS-IV.  The  operator  can  readily  see  what 
changes  have  occurred,  and,  using  the  editing  features  of 
the  existing  AUTOGIS  software,  can  change  the  data  base 
to  reflect  what  is  present. 

Thus,  graphics  superposition  provides  a  capability  for 
interpretation  and  update  using  a  stereo  model  that  has 
not  been  previously  available. 

There  is  perhaps  an  even  greater  use  for  graphics  super¬ 
position  than  that  mentioned  above,  however.  In  the 
discussion  above,  we  considered  the  display  of  information 
which  was  currently  being  digitized,  or  being  updated. 
Suppose  now,  that  one  were  to  display  other  information 
than  that  being  derived  from  the  model.  For  instance, 
suppose  that  one  was  performing  stereo  geologic 
interpretation  for  oil  exploration.  One  could  display  the 
magnetic  or  gravimetric  map  over  the  imagery,  so  that 
the  geologic  interpreter  could  see  this  auxiliary 
information  visually,  and  thereby  draw  conclusions  which 
might  not  become  evident  from  the  photogeology  alone. 

Subtle  features  which  he  might  normally  overlook  might 
become  obvious  in  the  context  of  explaining  a  magnetic 
anomaly  which  appeared  on  the  overlay.  Thus,  for  lack  of 
a  better  term,  the  APPS-IV  has  become  a  tool  to. fuse 
the  various  types  of  input  information.  Because  the  stereo 
photogrammetric  model  is  such  a  natural-appearing  phenomena 
to  most  observers,  the  superposition  of  auxiliary 
information  into  this  model  provides  a  natural  way  in  which 
to  accomplish  such  synthesis. 

In  another  arena,  suppose  that  a  military  interpreter  could 
see  electronic  intelligence  returns  superimposed  over  a 
current  reconnaissance  stereo  model.  Many  more  conclusions 
about  enemy  intentions  and  movements  might  be  capable  of 
being  drawn  than  from  the  imagery  alone.  Yet  another 
capability  presents  itself.  There  are  many  data  bases 
which  have  been  compiled  previously,  using  methods  which 
are  not  nearly  as  accurate  as  stereo  photogrammetric 
compilation.  Suppose  that  one  were  to  bring  these 
previous  data  bases  up  on  the  superposition  display,  along 
with  new  imagery.  Without  having  to  regenerate  the  data 
base,  the  operator  could  see  the  mismatches  in  the 
boundaries,  and  instruct  the  computer  to  move  the  coordin¬ 
ate  system  of  the  old  data  base  a  certain  distance  to 
accomplish  a  match.  Through  a  sequence  of  such  datum 
shift  operations,  a  previously  digitized  data  base  can  be 
updated  in  accuracy  to  fit  a  controlled  stereo  model 
without  the  necessity  of  having  to  redigitize  each  point 
in  the  data  base.  Whereas  redigitizing  all  of  the 
information  in  a  stereo  model  might  take  several  hours, 
this  shift  process  would  probably  take  only  a  few  minutes 
per  model.  Thus,  the  accuracy  of  the  old  data  can  be 
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upgraded  to  meet  higher  standards,  with  far  less  cost  than 
the  cost  of  redigitizing  the  entire  data  base. 

There  are  obviously  other  uses  for  graphics  superposition. 
Rather  than  elaborate  here  any  further,  it  is  appropriate 
to  discuss  further  developments  which  are  taking  place. 
Autometric,  Inc.,  is  currently  under  contract  to  the  U.S. 
Army  Engineer  Topographic  Laboratories  to  add  graphics 
superposition  to  the  second  optical  train  of  their  APPS-IV 
plotter.  After  this  development  is  complete,  many  more 
possibilities  will  be  present.  One  of  the  common  mistakes 
of  persons  performing  digitizing  in  a  stereo  model  is 
neglecting  to  change  the  elevation  as  a  feature  is  being 
followed.  Were  this  feature  to  be  converted  to  image 
coordinates  from  the  geographic,  and  were  the  point 
elevations  not  correct,  the  graphics  overlay  line  would 
appear  to  float  in  the  air  or  sink  beneath  the  earth.  In 
fact,  the  operator  would  see  this  happening  in  a  real 
time  as  he  digitized,  which  would  tell  him  immediately 
that  his  dot  was  not  on  the  ground.  Of  course,  experienced 
operators  do  not  make  this  error,  but  many  of  the  operators 
who  operate  APPS-IV’ s  for  digitizing  operations  have  never 
seen  a  stereo  instrument  before,  so  such  mistakes  are  more 
common ♦ 

Another  obvious  application  would  be  verification  of 
previously  produced  terrain  models.  By  putting  a  small  x 
or  dot  into  the  stereo  superposition  display  for  each 
point,  and  by  using  a  high-resolution  stereo  photo- 
grammetric  model,  the  operator  could  observe  the  degree 
to  which  the  dots  matched  the  surface  elevation.  By 
using  the  APPS-IV  floating  mark  to  measure  both  the  height 
of  the  surface,  and  the  height  of  the  dots,  the  bias  could 
be  determined  at  the  location  of  each  dot.  In  fact,  model 
join  lines  or  other  anomalies  which  change  the  systematic 
bias  can  be  detected  as  ledges  in  the  fit  of  the  overlay 
to  the  terrain,  and  the  outline  can  be  measured  using  the 
APPS-IV,  and  then  a  correction  for  bias  applied.  The 
operator  will  instantly  see  the  effects  of  the  change  to 
the  elevation  matrix,  and  therefore  can  determine 
immediately  when  the  proper  corrections  have  been  applied. 
Individual  points  which  represent  spikes  can  be  edited  in 
real  time  in  a  like  manner. 

Perhaps  the  most  esoteric  application  of  stereo  super¬ 
position  is  in  flight  simulation.  Since  the  height  of 
the  graphics  above  the  terrain  can  be  sensed  visually  by 
the  operator,  one  could  plot  aircraft  or  remotely  piloted 
vehicle  flight  paths  on  the  graphics  overlay,  and  the 
operator  could  see  immediately  the  extent  to  which  the 
proposed  path  clears  terrain,  and  how  the  path  would  avoid 
missile  defenses,  radars,  etc.  Thus,  a  complete,  inter¬ 
active  mission-planning  center  could  exist.  Pilots  could 
sit  down  at  an  APPS-IV  and  actually  fly  the  nap-of-the- 
earth  mission  before  they  climbed  into  the  cockpit,  thus 
increasing  their  confidence  considerably  in  the  reliability 
of  their  terrain  avoidance  plan.  By  seeing  where  the 
flight  path  went  relative  to  enemy  defenses  (the  defenses, 
of  course,  could  be  put  up  on  the  same  overlay) ,  the  pilot 
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would  get  a  better  idea  of  how  to  fly  the  mission  to  avoid 
these  obstacles. 

CONCLUSIONS 

It  is  evident  that  graphics  superposition  supplies  a 
valuable  tool  for  mapping,  imagery  interpretation,  and 
military  planning.  The  capability  exists  now.  What  is 
even  better,  the  design  of  the  standard  APPS-IV  is  such 
that  the  capability  can  be  added  in  a  matter  of  hours  to 
any  existing  APPS-IV  having  either  the  Bausch  and  Lomb 
Stereo  Zoom  Transfer  Scope  or  the  new  model  3500  optics 
as  a  field  retrofit.  Thus,  the  decision  to  buy  super¬ 
position,  either  single  photo  or  stereo,  does  not  have  to 
be  made  at  the  time  of  the  initial  purchase.  The  software 
to  drive  superposition  is  presently  incorporated  in  the 
AUTOGIS  software  package,  and  could  be  easily  added  to 
other  APPS-IV  packages.  As  with  all  other  APPS-IV  firm¬ 
ware,  the  instructions  for  interfacing  from  the  host 
computer  are  explicit  and  straightforward. 

Graphics  superpositon  has  supplied  the  first  truly  real¬ 
time  feedback  of  not  only  newly  digitized,  but  also 
previously  data-based,  information  to  the  operator,  which 
can  be  used  without  removing  the  eyes  from  the  eyepieces, 
and  thereby  losing  visual  accommodation.  The  potential 
uses  are  limited  only  by  one's  imagination. 


